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Negotiation Sy stem 

This invention relates to apparatus and processes for supporting business 
negotiations for procurement of commodities and services, and in particular the use of 
5 electronic agents to describe and offer commodities and services to one another. In this 
specification, commodities and services will collectively be referred to as "products". 
Hitherto, two approaches have been followed in this area. The Web Services 
Interoperability organisation (WS-I) have proposed a common web service profile 
language which describes the service in terms of how to invoke it, whilst the Defence 
10 Advanced Research Projects Agency (DARPA)Web Service group have developed an 
XML based service description language known as DAML-S, which describes the service 
in terms of what it does. DAML-S does not have a descriptive ontology for interactions, but 
does have a process model which can be used to explicitly describe protocols. This is 
described by Ankolekar et al in the Proceedings of First International Conference on the 
15 Semantic Web, Sardina, Italy. June 9*" - 12 th , 2002 

Bartolini et al of the University of Southampton (Proc. 3rd International Workshop 
on Agent-Oriented Software Processing, Bologna, Italy, 87-98 (2002)) describe an 
ontology for negotiation. Tamma et al, of the University of Liverpool (Proceedings of the 
Workshop on Ontologies in Agent Systems, Bologna, Italy, July 2002) describe a similar 
20 system, but there is a difference in that the object of the negotiation is discussed. 

United States Patent 6347307 describes a system in which a taxonomy/ontology 
(FinXML) specifies interactions such as "spot", and "InterestRateFixedFloatSwap". 

According to the present invention, there is provided apparatus for supporting 
negotiations comprising a group of agent means, wherein at least one of the agent means 
25 comprises means for initiating interactions between the agent means, and means for 
defining the negotiation in terms of one or more phases during which particular parts of 
the negotiation are completed, such that the responses to requests in an earlier phase in 
the process constrain the responses generated in subsequent phases, and wherein each 
agent means has means for dynamically negotiating an agreement in accordance with the 
30 said definition. 

The present invention also provides a method for performing negotiations using a 
plurality of computer-based agent means, wherein one of the agent means initiates 
interactions between the agent means, and the agent means dynamically negotiate an 
agreement, and the negotiation process is defined in terms of one or more phases during 
35 which particular parts of the negotiation are completed, such that the responses to 
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the method of the invention or to provide the apparatus. 

The invention allows the negotiation prooess to be opened interpreted and 
executed as a number of phases, toe outoome of each phase eing u^Tl 
posstbie set of sto.es a, subsequent phases. The availably of op ions for del 
dunng each phase of the nego.ia.ten may be constrained relative to toe possibL steteTo 
e overa nego«ation. Because the rutes of subsequent phases can be retdeved ^ 
to lowng these ruiee oan therefore use toe constraints toa, wil, be imposed in toe te^ 

r;;a:rz;r n,od6,eminefteira * nsin ^ eartyp ^ 

detent t kh * 00n5,^a " 1, ° n ^ ■ M * iS to b * later to 

determme the b,d ranges they should operate In for an early quality phase 

«*, «. ""T " Pr t dUOr referred 10 ab0V6 ^ b8 any OU,Come deslred •» criginator of 
the rsques,, such as toe supply of a physical commodi* or senrice, or a more abs^t 

outcome such as a financial faction or a oomputotio. The inversion can be useTin ^ 

on^o-many s„uation (where there is mors than one potential supplier of toe product) or 

20 s 77 a "° n Where 18 TOre *- ™ «— r for a 

20 suppher. The process may also be extended to a many-to-many situation 

in contrast to toe prior art systems, toe present invention uses a componentized 
characters of toe descripUon of toe interact rules b«ween toe parish* ^ 
e^, a on, which risers to,m the prior ar, systems discussed above in toa. toe phaTtf 
nego«,a„on are decomposed more fully. The prooess places more emphasis on lifecycle 
nule^escnbes tokens in .he negotiation process instead of Jus. tension 

ale ai. to , " " ^ " a »3 * 

handte all «» ^ ^ ^ ^ ^ ^ 9 

dt* on toe r T^'"" 8 °' ^ '° be — ' * a 

decdng on toe opfmal response, and toe range of possible solutions, strategies and 

dec,s,ons wKhln toose dimensions, a. smailertoan in toe prior art single phase sZts 

By operating as a sequential process, the various elements of the finally 

nego,a.ed resuK can each be handted rigorously, and wKhou. toe need for p Jeten^d 

for each relevan. faCor to be applted by each agent The Invem, „ alsolws 
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Th.s process more closely follows the behaviours expected of human participants 
.n an auct.cn process, in which possible outcomes are first identified and more detailed 

iZ ! tH iS T ' imited t0 th ° Se P ° SSibi,itieS - is therefore — ged to 

■nterpret these descnptions and act on them. In particular the descriptions of the process 

are ,n terms of the phases of activity in an interaction. For example, using the present 
.nvent,on ,t ,s possib.e to spectfy a pre-qualffication phase, a phase in which the 
characters of the commodity are negotiated and a phase in which the price of the 
commodity is negotiated. The outcomes of the phases of the negotiation can be tied 
together , n a way that can be interpreted by a program; it is possib.e to specify a concept 
l.ke the pr,ce agreed in a given phase will be the only price that will be lega. in 
subsequent phases". This is significant because it constrains the size of the space that 
agents must reason over when composing bids at each phase. A constraint specified for 
an eariier phase may therefore be used to constrain the reasoning to be used in a later 
Phase. A constraint can a«so be used in reasoning of phases previous to the one in which 
the constraint wi.l appear. For example, agents that interpret the service description will be 
able to determine that, if price will be constrained in a subsequent phase other 
cons.derations the subject of the current phase (quality, time of delivery, support and 
serv.cing) must be subordinate to the price at which the product can be offered 

The invention may be implemented in a peer-to-peer fashion, the necessary 
processing programming being downloaded to potential users. It could also be 
implemented over fixed servers, in which a server having the necessary software acts as 
the end user's agent. 

An embodiment of the invention will now be described, by way of example only 
with reference to the drawings, in which: 

25 Figure 1 shows the components of a typical general-purpose computer suitable 

for performing the invention. 

Figure 2 illustrates the functional programme elements that interact to perform 
the process of the invention 

Figure 3 is a flow chart illustrating the initial stages of the process of the 
30 invention. 

Figure 4 is a flow chart illustrating the subsequent stages of the process of the 
invention. 

A typical architecture for each of the computers 21, 23 on which software 

impementing the invention can be run, is shown in Figure 1. Each computer comprises a 
35 central processing unit (CPU) 10 for executing computer programs and managing and 
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controlling the operation of the oomputer. The CPU 10 Is connected to a number of 
dev,ces by way of a bus line 11, ,„e devices includinfl . , rst 
example a hard disk drive for storing system and application software, a second storage 
dev,ce 13 such as a floppy disk drive or CD/DVD drive for reading data from and/or writing 
5 data to a removable storage medium and memory devices including ROM 14 and RAM 
15. The computer further Includes a network card 16 for interfacing to a network The 
computer can atso include user Inputfoutput devices such as a mouse 17 and keyboard 
18 connected to the bus 1 1 via an inputfoutput port 19, as well as a display 20. It will be 
understood by the skilled person that the above described architecture Is no, limiflng, but 
10 ,s merely an example of a typical computer architecture. R will be further understood mat 

UtT-M a " ^ " eCeSSary SyStem and «"*—> s°«ware 

to enable it to fulfil its purpose. 

The invention is preferably implemented as an agent-based application, with the 
negation session controlled from a negotiation p.atform 22. In general the negotiation 

15 platform and the individual agents 21, 23, 24 wouid each be hosted on different 

computers such as that shown in Figure 1, communicating with each other, through their 
mput/output ports 19, using protocols such as the standard internet protocol or the XML 
Web Service" standard through a distributed computing network such as the public 
Internet", a private "intranet", the supercomputing network known as "the GRID" or some 
20 other communications medium. However, one or more of the agents 21 , 23 24 may 
be hosted on the same hardware as the negotiation platform 22. 

The process is illustrated in Figures 3 and 4. In each negotiation session, the 
entrty under negotiation is represented by a negotiation matrix, describing the details of 
that entity. A session normally consists of one initiator and one or more respondents. An 
25 mitiator 21 is the entity (user and software) that initiates a negotiation session For 
simplicity only one respondent 23 is shown in Figures 3 and 4, but it will be understood 
that the initiator 21 corresponds in a similar manner with each respondent 

The originating agent 21 first defines the rules and the matrix of the session The 
onginating agent 21 begins this process by retrieving from the store 22 a previous.y- 
30 generated definition of the interactions required in a negotiation, and the purpose of each 
interaction. ,t also retrieves a process that meets this definition. The process by which 
this data ,s generated for subsequent retrieval will be discussed later. The definition 
retrieved by the originating agent defines the negotiation process to be followed in terms 
of a negotiation rule, which specifies the individual phases and the transitions between 
them, and a negotiation matrix, which defines the item under negotiation. The negotiation 
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rule refers to the state of the negotiation matrix at the current phase of the auction thus 
defining the purpose of that phase of the interaction in terms of the previous phase and 
the next phase. 

The program retrieved from the store interprets the rule in two ways. Firstly the 
5 program contains instructions as to how the agent should generate messages and 
responses at a given phase in the interaction. Secondly, itsets bounds on the bids that the 
agent should evaluate for utility at this phase of the interaction. Bids can be considered 
mathematically to be sets of curves, (or sets of points if the solutions are constrained to 
take d,screte values), representing the conditions that agents are prepared to declare as 
1 0 being possible at the current phase of the interaction. 

The interaction with the responding agents is shown in Figures 3 and 4 Having 
generated the rules under which the negotiations will be undertaken, the originating agent 
21 transmits these details to the repository 22 (step 30) where they can be accessed by 
other users 23 etc. 

15 Having received confirmation that publication has been successful (step 31) the 

ongmator 21 then opens a negotiation session (step 32) by issuing invitations to potential 
respondents 23, etc. This may be done in a number of ways. For example, agents may 
have advertised that they are interested in participating in interactions in a directory that is 
accessible to the originating agent, and the originating agent then contacts them when it is 

20 ready with invitations. Alternatively, the prospective respondents may send subscriptions 
to onginating agents that have advertised in a directory, which then send invitation 
messages to them when it is ready. Agents may also advertise interactions becoming 
available, together with information about them (how to join and the rule) in an accessible 
d.rectory, and prospective respondents poll the directory to find interactions that are of 

25 .nterest to them. The accessible directory can be a single central file store like UDDI 2 0 or 
Google, or a federated store like a FIPA DF or the proposed UDDI 4.0. Alternatively a 
peer to peer arrangement may be used, in which the agents form a federated network and 
respond to information queries by saying what they know and asking all their contacts 
about it. 

30 The entities 23 interested in responding to the invitation 32 next request the rules 

from the repository 22 (step 33) which are returned (step 34) to the responding entity 

Those entities 23 that desire to join the auction return a "request to join" (step 35) 
which is acknowledged if the request is valid (step 36). These entities 23 are then 
constrained to follow the rules and the matrix of the session. 
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When a predetermined condition Is attained, such as a time or number of 
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the negotiation process. 

10 Figure a^ZT, 1 ™" ^ " ^ ^ * "•** * 3 »*» «" - 
Figure 3 and consists of a sequence of one or more negotiation phases with natural or 
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as speech acts that are tagged with a declaration of intent (ask, tell, bid, query prepose 
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Each phase in a negotiation session has one of the three dialogical properties- 
srngi. round, double round or muitipie round. In a muWpie round phase (sips 41 Tl 3 
25 44) a proposal (41, is made and a response is returned (42) ftis response' is ft- 
evaluated (step 43) and ■ , defines fta, fte ex, criteria have be I ZZ pre^ 
proceeds to the next phase (step 45). Ofte^ise a new counterproposal is genZo 
(step 44) and the phase is repeated (41 , 42). generated 

Some phases may take a predetermined number of rounds In a alnote m„„H 
30 phase ,45, 46) .here „ Jus, one exchange * messages (propose 45.- JL£2£Z 
a double round phase (no. shown In Figure 4, there are three steps: (proposl coul^ 
propose: accept/reject) counter- 

Figure 4 is merely illustrative. Of course, there may be more than the three 
Phases shown in Figure 4, and each phase may have any of the three 
35 properties discussed above. a'aiogicai 
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The terminating conditions are controlled by further properties, such as an upper 
hmrt on the number of iterations (MAXROUND), or a time out condition 

Upon a valid selection, the last phase begins a final step 47 that automatically 
.nvokes finahsation and rejection procedure. There may be further final phase processes 
5 such as calculation of tax or service provided commission, which may vary depending on 
the successful bidder in the negotiation, but are not relevant during the negotiation. 
Moreover, there may be a requirement for additional functions. For example where an 
order ,s being placed against a specification (for example a new car to be built to order) its 
production has to be arranged. Where the order is for an identified specimen (for example 
10 a second-hand car) inspection may be required before the order can be completed Other 
factors such as delivery arrangements may also be necessary. 

Once the final negotiation phase has been processed, a further set of rules 
determines the final price. of the deal, and any matching algorithms to handle lot 
allocations and price determination. There is then a finalisation process where both 
15 consenting parties regard the negotiation session as ended with a mutually agreed 
obligation. The session is then terminated. 

If appropriate, for example in the event that none of the respondents have been 
able to meet the conditions specified in the session, the initiator 21 may instead run a 
rejection process to inform all the respondents that the negotiation session has been 
20 terminated. 

The platform 22 may be instructed to navigate non-sequentially to any 
negotiation phase. -The initiator 21 can also alter the negotiation rules at run time The 
Platform 22 provides a default evaluation according to the Pareto optimisation process 
Th,s process generates a matrix which produces the optimum overall score The 

25 .mplication is that if any alternative matrix would be better, for all participants, than the 
one generated by the decision making process, this alternative will be selected 
automatically In other words, the decision making process cannot generate a request 
matnx that is sub-optimal to an offered matrix if such alternatives would not be acceptable 
to one or other party. To override this behaviour, the decision-making process must be 

30 capable of overriding the transition process selected by the program The decision- 
makmg process adheres to a defined programmatic interface [AgentFunction]. The 
dec,s.on making process can rewrite itself at run time; or it can register another decision- 
makmg process program for a negotiation phase. The platform uses an adaptive loader 
program, which imports the program code that it runs to make a decision as it runs and 
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updates it regularly during running. Code is loaded at every discrete time of the 
negotiation session. 

In the decision making process, the interface is implemented in the form of a 
function called "method" with a parameter of type "decision (number)", where "number" is 
5 the numeric equivalence to the sequence number of the negotiation phase. Note that the 
numbering starts from "0". A default function method [genera.Decision) is implemented 
when a specific function is not provided by the implementing programmer. That is to say if 
the platform attempts to invoke a function that has not been programmed into the system 
then the platform will attempt to invoke the default [generalDecisibn] instead. 
10 The program data to be used in the process may be generated using the 

following steps. 

Definition step: preparation of a set of evaluation functions and a set of sequent 
rules. These are placed in the interpretation store 

Intialisation step- Definition of the rule of the negotiation (number of phases 
15 message rules per sequence, good at sequence, timings/exit/entry criteria) and 
publication to the advertising directory. The initiator constructs the rule from its 
.nterpretation store, either due to a program or due to rules defined by a programmer that 
act over the initiator's current perceived requirements 

First neqotiation phase- t he participants find the declaration and load the rule 
20 from the advertising directory. They use the rule for all phases of the negotiation as input 
to evaluate the bids that they should make in phase 1 . 

Subsequent neqotiation phases- W hen the exit criteria for the previous phase has 
been reached all participants move to the next phase. They continue to bid as before but 
their evaluations are further constrained by the outcomes of the previous phases in 
25 addition to the constraints described for this phase and phases to come. 

Final neqotiation p hase- during the final phase bids are evaluated using only the 
final phase's constraints and the outcomes of all previous phases. 

These steps will now be described in more detail. There is first an initialisation 

step 

30 NegotiationProcess eng = new NegotiationProcessOemp.nameswvers); 

A process is then called to set up any necessary GUI that is required, different 
processes may provide different GUIs 

eng . setStandardGUI ( true ) ; 
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The session is then created, and its type defined. The contract net message 
sequence rules are retrieved from the data store 

Negotiation neg = eng. createNegotiation ( ) ; 

neg . setNegotiationType (Negotiation . CONTRACT_NET ) ; 

5 

Next the names are set for the functions that are to be called at each phase of 
the negotiation process 

neg. cs. programs = new String [neg. cs . states . length] ; 
for (int j=0; j<neg.cs. states. length; j++) 
10 if ( j == 1 ) 

neg.cs. programs [j] = "programl"; 

else 

neg.cs. programs [j] « "programed" ; 

(Program 1 and program 2 are decision procedures that are retrieved for 
15 particular phases. ) 

The parameters of the negotiation rule/matrix for declaration are now set 

neg.setNegotiationDetails("bid", 1, 100, "something", "no desc"); 



20 



These terms parameterise the retrieved decision functions 

The negotiation process is now begun 

eng. startNegotiate (neg) ; 

When a new proposal (i.e. negotiation matrix) is received by a user agent 23, the 
25 add(Performative) method in Process will be invoked by the recipient 23. This method 
needs to be adapted to the requirements of the individual agent's programs, so that the 
agent will invoke the program. Thus the rule is retrieved from the return message 34. For 
example: 

YourProgram you = new YourProgram( . ) ; // or register 
yourself with the CoordinationState 
you.newMatrix (cs) ; // 

cs is the CoorStruct extracted from the performative. 



30 



Then the required data structures are set up: 
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String key = context .whoami () + »_» + context. newld() ; // or 
any unique string 

CoorStruct newcs = new CoorStruct (cs) ; // make a copy 
newcs . key = key; 
5 newcs. phaselD = "N10"; 

newcs. bidNo = "1"; 
newcs. programs = new String [cs . states . length] ; 

A value rs,tran is set to 1 for a bid, otherwise 2 
10 // must be respondent 

newcs. xml.priceD = (cs .tran. equals ( "bid") ? 1: 2); 

The actions for the evaluation states for all steps to programA are set, and the 
response engine is set to use this 

15 for (int i=0; i<newcs . states . length; i++) 
newcs. programs [i] = "programA"; 

Coordinations tate . Process ( ) . response (newcs ) ; 

20 In order to navigate around the negotiation phases in the decision making 

process, for example, a routine is created 

public void decision2() { 
if ( round < 10 ) { 
25 jumpto(O); // go back to phase 0 

cs.xml. price = "10"; // any my price will be . . . 
return; 

} 

• a a 

30 } 

The current platform implementation makes use of the "price" attribute to 
demonstrate how a decision can be made. It can be replaced by an XML representation 
(be it a XML document, object or whatever) where a richer set of attributes is required to 
35 form the negotiation matrix. As an example, 
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public void decision3() { 

if { round < 10 | | time > 12 ) { 

cs . xml . attributeA = "I want this"; 
5 cs .xml .attributeB = "I want this too"; 

• • » 

return; 

} 

10 } 



The platform provides several interactive facilities and controls for quick testing 
and manipulation. 

15 

public void decisionOO { 
• • • 

if ( cs .xml .price > 100 ) { // assuming it is numeric 
prompt (cs. xml. price) ; 

20 

return; 

} 

} 

25 

The above will invoke a time-countdown window showing basic information about all the 
alternatives, and the price the decision making process has just computed, and ask the 
user for further instruction. 

30 public void decisionOO { 
... 

if ( time > 100 ) { // assuming the scale is meaningful 
quit(); 

35 return; 



WO 2005/013166 



12 



PCT/GB2004/003251 



} 



The entity will then terminate or drop out from the negotiation session 

5 

The platform is a "peer-to-peer" decentralized implementation, although it could 
make use of static directories and repositories or platforms. Although there is no 
persistent entity in the system that can act as a central authority or broker in any high level 
sense to hold the "market rules and information", a limited form of many-to-many 

10 negotiation can be supported. Such negotiations can be considered a "market", that is to 
say, an institution that allows multiple identical negotiation sessions and has a long life in 
comparison with the durations of individual sessions. During any negotiation process, a 
software entity can request to join as a further initiator for that session. The original 
initiator can, of course, reject any such request. 

15 The process could be extended to a many-many situation. The process would be 

continuous, and the participants would all advertise their participation through a publicly 
advertised known contact point. A ACID transaction mechanism could be used to 
underpin the system to prevent double commitment, although some protocols such as 
contract nets specifically impose risk on the bidding agents - forcing rational agents to bid 

20 lower to account for the risk of an unwanted purchase. Participation and drop out, would 
be possible ad hoc. As will be understood by those skilled in the art, any or all of the 
software used to implement the invention can be embodied on any suitable transmission 
and/or storage medium using any suitable carrier readable by a suitable computer input 
device, such as. CD-ROM. optically readable marks, magnetic media, punched card or 

25 tape, or on an electromagnetic or optical signal, so that the program can be loaded onto 
one or more general purpose computers, or downloaded over a computer network using a 
suitable transmission medium.. 



